According to @_avichawla, speculative decoding lets small models guess K tokens and big models verify at once, delivering 2–3x faster LLM inference.